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MQ^SURING THINKING SKUiLS 



"Th«re are OM-'Stocy intellects , two-story intellects and three-story 
intellects with skylights. All fact collectors who have no aim 
beyond their facts are one*stocy people. Two-story people coaparef 
reason, generalise, using the labor of the fact collectors as their 
own. Three-^story people idealize, iaagine, predict~their best 
illuBination oosms frca above through the skylight." 

Oliver Wendell Holaes 



If we are to teach thinking skills, we Mist plan and conduct instruction 
in a careful Banner. Careful planning entails diagnosis of the thinking 
skills students have already ouwtered anu the skills they have yet to learn. 
In addition, we auist be prepared to determine the iopact of our instruction 
once coaipleted. Diagnosis, monitoring and evaluation require that the teacher 
be capable of measuring thinking skills in the classroom on a day to day 
basis. The measurement of student achievement is a challenging process even 
when our goal is sii^ly to measure student recall of facts and information. 
When we add the challenge of measuring the students' ability to use that 
information to think critically and solve problems, the measurement process 
takes on new and imposing dimensions of complexity. 

In the past, we have failed to rise to this challenge. A recently 
completed study of teacher**developed tests in a large metropolitan school 
district revealed that nearly three quarters of the thousands of test items 
analyzed across grade levels tested recaJ.l of facts and information (Fleming & 
Chambers, 1983). Very few tested the application of higher order thinking 
skills. Pew tested the ability to analyze available knowledge or to draw 
inferences about or with newly learned facts and information. Few items 
tested students' ability to draw conclusions and support evaluative judgments. 
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Yetr th« dftvtlopMnt of thinking skills is bsooaing a higher and higher 
priority asong aducators and critics of education. As this interest has 
intensified r the inadequacy of our current instruction and assessaent of these 
skills has beoose apparent. Quellaals (1985a) has characterized the problem 
as follows I 

The call for attention to higher-order thinking skills rings 
throughout the educational systes. Educators, policymakers and the 
public agree that higher-^rder skills are isportant but neglected in 
curricula and tests and, therefore , underdeveloped in students. We 
have sufficient rhetoric and evidence to establish the need for 
reneifed eapbasis on higher-order skillsi vhat we lack is consensus on 
irtiat higher-order thinking is, on how to-aeasure ite outcoMSr and on 
bcm to teach it. Purtheraorer despite the lip service paid to the 
significance of higher-order thinking skillsr adUnistratorsr 
teachers and studente aay view thinking skills as tangential to 
required courses of study r as appropriate only for older r high 
achieving studente r or as too demanding of time and effort. To 
coapound the problesr adainistrative and economic support for 
projects have often been too weak or short-lived to establish and 
aaintein thinking skills assessaent and curricula (p. 1). 



Bfforte are now underway on several fronte to begin to deal with this 
problem. For instance , researchers are striving to understand the thinking 
process and translate their understanding into pract-ical classrooa teras 
(Quellaalz, 1985b). Authors of instructional aaterials are designing texts 
and study guides which aove beyond recall (see the junior high social studies 
text by Joyce and other s, 1980 r for exaaple). Several stetesr including 
Californiar Connecticut and Colorado, are instituting stetewide assessaente of 
critical thinking skills with the intent of raising these skills to higher 
levels of priority in local curricula. Many other stetes are launching new 
instrtictional program in this arena. 

This guide is designed to contribute to the growing effort to teach 
critical thinking skills by providing teachers with sir t>le but very powerful 
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tools to umm in Masuring thomm skills on a day-to-day basis in the 

classroQS. Specifically , it pcovi<!es: 

e a siaplSf usable set of definitions of thinking skills, 

e brief explanations of three coaarn foras of classrooa assessment, and 

e a planning strategy for crassing levels of thinking skills with forss 
of classrooa assessaent in each a way as to use assessment to pronote 
student skill in higher level cognitive operations. 

In addition, teachers are given a series of very practical guidelines for 
making the assessment planning strategies work effectively in the classroom. 

The guide is written for teachers, nowever, thoce who support the 
teachers* instructional efforts (adiinistrators, curriculum specialists, etc.) 
should also find it useful. The strategies discussed can be applied to all 
subjects at all grade levels. For purposes of illustration, we have included 
a range of examples of assessments covering concepts taught in science, social 
studies, and language arts (composition and literature). Exaoqples also 
illustrate elementary, junior high and high school levels of instruction. To 
aid in learning and using these strategies, space is provided throughout the 
guide for users to fill in examples relevant to their particular context. 
This feature of the guide makes it easy for teachers and others to begin to 
address issues related .to teaching critical thinking skills. 

The Benefits of Assessing 

Teachers who know how to assess thinking skills derive many benefits. The 
most important of these was mentioned at the beginning of the guide. Our goal 
in education is to teach students to ubg the information at their disposal. 
We want them to do far more than just restate facts. We want theo to think. 
Very simply, we are doomed to fall far short of this goal if we are unable to 
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■onitor d«v«lopMnt and Masur« student aastary of the thinking skills ws SMk 
to iapsrt. If vs cannot Masurs skills aastsrtd, m cannot dstsrains %ihat to 
taach naxt. If va cannot Masure the skills va teach, we cannot knov if 
instruction was effective. 

from another perspective, it is iaportant for the teacher to be able to 
Masure higher ordeic thinking skills because our tests do nore to tell 
studenU vhat we expect of thw than any other single factor. Much of what 
students study and learn is stimulated by what they think we as educators 
expect of thea. They learn those es^ectations froM our tests. If we test 
recall, they learn the facts. If we test Mre, they prepare theMelves to 
deliver aore. 

FrcB still anotlier perspective, teachers who know how to devise their own 
aeasures of thinking skills have aore degrees of freedom in designing 
instructional plans. They can adjust their questions to new textbook 
adoptions and not be diained to text materials that don't teach thinking 
skills. Teachers skilled at aeasuring thinking skills can tailor their 
assessaents and instruction to unique needs and capabilities of students, thus 
permitting individualisation of instruction around categories of cognitive 
operation. And they can critique text aaterials being considered for adoption 
from the perspective of their likely influence on students' thinking skills. 

This role of the teacher as a critical consumer also becomes important 
from another point of view. Teachers skilled at measuring thinking skills can 
review and evaluate standardized tests being considered for adoption by the 
district— thus ensuring that tests selected match instructional priorities in 
their classrooms. Not only must these published tests be selected to cover 
appropriate content (i.e., match the objectives of the teachers whose students 
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are to be tested) but they auet also measure thinking skills taught in the 
classroosi. To the extent thct the test fails to natch local content or 
thinking skill priorities, that test will provide invalid inforaation 
regarding student achieveaent. 

The Assessment Planning Praaework 

Our goal is to es^lain how basic thinking skills^skills students must use 
in solving significant acadeaic and life probleas~can be assessed by using 
three oooaon foras of classrooa assessaent. To achieve that goal, we provide 
training in aeasuring five fundaaental cognitive operations: Recall, 
analysis, coi^rison, inference and evaluation, aeasured via (a) oral 
questioning during instruction, (b) paper and pencil objective test iteas and 
(c) perfornance assessaent (i.e., based on teacher observation and judgaent). 
These eleaents are defined in detail below. When combined, these dimensions 
provide a simple, yet coaprehensive fraaework frca which to view the classroom 
aeasureaent process. 

In preparing a guide to address this fraaework, we made several 
assuaptions about the teachers who will use the guide. We assumed that 
teachers (a) are proficient at writing basic test items using common item 
formats (e.g., essay, multiple-choice, true/false, etc.), (b) are proficient 
at designing and using measures of student achievement based on observation 
and professional judgment, and (c) are knowledgeable about the subject matter 
they teach. We have made these assuaptions for two reasons. First, space 
lirait/^tions will not allow instruction in these areas. And second, these 
skills are not essential to understanding our planning strategies. However, 
if teachers are to use our planning strategies effectively in the classroom. 
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buic tMt d«v«lopMnt skills and a kaan knowledge of content are very 
iaportant. Therefore, for the reader who wants assistance in theses areas, we 
suggest resources to use in parallel professional developswnt efforts. (See 
Appendix A) 

Defining Thinking Skills 

If we are to measure thinking skills effectively and efficiently in the 
deaanding, fast-paced world of the classroom, we aust start with a clear and 
usable definitions. The task of specifying the donain of thinking skills has 
challenged philosophers , cognitive psychologists and subject**witter experts 
for decades—even centuries, we will not bore you with the details of that 
history of discovery. Instead, we have synthesized prior conceptual 
fraaeworks into one we think will suffice for nost classroosw (Quellmalz, 
1985). Mien we coapare the basic cognitive operations involved in the prob)^ 
solving and critical thinking skills proposed by philosphers, psychologists 
and educators, five fundaaental coaponents recur: recall, analysts, 
coaparison, inference and evaluation. These skills are unnrl at varying points 
in the problea solving and critical thinking processes as students 1) identify 
the problea type or central issue, 2) identify ana find relevant infor:.^tion, 
3) connect relevant inforaaticn, and 4) evaluate solutions and conclusions. 
The skills are also aajor foras of explanation and inquiry in their own 
rights. 

fto do not characterise the skills as a rigid hierachy since there aay be a 
wide range of difficulty widiin each category. Analyses aay be siaple or 
coi^lex, depending upon the scope and conf)lexity of the problem siailarly, 
evaluations aay be easy or difficulty. Generally speaking evaluation and 
inference draw upon the other reasoning operations as well. The primary 
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distinction aaong these five catsgoriss of thinking skills is that they refer 



to different ways that students relate and use inforaations 

Recall: Most tasks require that students recognize or resMber key 

factSr definitions^ conceptSr rules and principles. Recall 
questions ask students to repeat verbatia or to paraphrase 
given inforMtion. To recall inforaationr students need aost 
often to rehearse or practice it, then to associate it with 
other, related concepts* 



Analysis: In this operationr students divide a whole into cosponent 
elements. Generally the part/whole relationships and 
cause/effect relationships that characterize knowledge within 
subject dcuins are essential cosponents of aore coaplex 
tanks. The components aay be the distinctive characteristics 
of objects or ideas or the basic actions of procedures or 
events* 



Conparison: These tasks ask students i:o recognize or e]q>lain siailarities 
and differences. Siaple cos^risons require attention to one 
or a fow very obvious attributes r or coaponent processes r 
while coaplex coaiparisons aay require identification and 
differentiation awng aany attributes or coaponent actions. 

Inference: Both deductive and inductive reasoning fall in this 
category. In deductive tasks, students are given a 
generalization and asked to recognize or explain the evidence 
that relates to it. Applications of rules and * if-then" 
relationsh^s require infereneing. Inductive tasks give 
students the evidence or details and ask students to coaie up 
with the generalization. Hypothesizing, predicting, 
concluding and synthesizing all require students to relate 
and integrate information. 

Evaluation: These tasks ask students to judge quality, credibirity, worth 
or practicality. Generally we e]q>ect students to use 
established criteria and es^lain how these criteria are or 
are not net. The criteria nay be established rules of 
evidence, logic or shared values. 



2161e 



12 



HM« at* domm si^pU illustrations of how thu highsr^rder reasoning skills 
aK>«ar as aajor foras of ss^lanation and inquiry in three general subject 
■atter donainss 



Science 

Analyse Identify coaponents 
of a process r 
features of aniaate 
and inaniaate objects 

Ccsipare The properties of 
objects or 
cQBQxments of 
processes. 



Infer Draw conclusions. 

Hake predictions. 
Pose hypothesis 
tests and 
explanations. 



Evaluate Soundness of pro-* 
cedures. 
Credibility of 
conclusions. 

Significance of 
f indings< 



Social Science 

Cosponents of arguaents 
Bleaents of an event 



Causes and/or effects 
of separate events. 
Socialr political, 
eoonoaiCr^ gcograpt ic 
features • 

Predictr hypothesise r 
conclude, interpret 
using historicaXr 
socialr politicalr 
vcnnoaic, geographic 
inforaation. 



Literature 

Identify ccaponents 
of literary, exposi- 
tory and persuasive 
discourse 



Meaningsr theaes, 
plotSr characters, 
settings r arguaents 



Th^mSr significance r 
characters' aoti* 
vat ions. 

Interrelationships 
of literary eleaents. 



Credibility of arguaents, Believability. 



decisionsr or reports. 

Significance 



Significance. 
For a. 

Conpleteness. 
Clarity. 



others have subdivided thinking skills in other ways. Blooa and others 
(1956) have suggested six levels of cognitive operation which have been 
extensively studied and applied by educators. These aight we:!l have been 
substituted for our five levels in this guide. In fact they are outlined in 
Appendix C. we adopted those outlined above tr illustrate our assessaent 
planr.ing strategy because of their siaplicity. But the key to success in 
aeasuring and teaching thinking skills in to adopt a taxoncoy of skills and 
use thea consistently. 
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roras of Clasarocai Assessacnt 

The MasureMiit of student achieveMnt can take aany forna in the 
dasaroMs aoaw foraal and aoaM informal; acme individual and some group; 
soaM standardized for all claaarooaM and 8oe» tailored to the specific 
claariTooa context. For the purpose of illustrating these Masurement 
strategiea, we have selected three of the nost coaabn foras of assessment: 
oral questions asked during instruction, paper and pencil tests and 
perforaance nests. Bach is described and illustrated below. 

Oral ctufistions. These are the questions^ teachers ask during instruction 
for the purpose (s) of (a) stimilating thought and discussion among students 
and (b) providing teachers with a brief sample of evidence by which to monitor 
students* skill develo{3ment and achievement. These questions may stimulate 
students to think divergently and creativelyf exploring interpretations of the 
knowledge at their disposal. Oral queations may be directed to an individual 
student (volunteer or not) or of the cleiss as a whole to stimulate a 
discussion. They are open-ended, often allowing for more than one correct 
answer. They may cone at a rapid-fire pace, demanding brief responses and 
quick follow up questioning by the teacher, or they may be posed in a more 
thoughtful manner, allowing extended explanation and interpretation. This is 
an informal mode of monitoring and assessment- that is most often an integral 
part of instruction. For example, the teacher might ask, "What eu:e some ways 
we might have avoided use of the atomic booib at the end of WWII?" Although 
this is not part of the foraal testing for grading purposes, it is very mi!ch a 
part of the classroom monitoring and evaluation environment. 

Paper and pencil tests . This form of assessment includes the test items 
teachers include in their more formal written tests and quizzes for purposes 
of diagnosis, grading or placement. They have traditionally ^een used to 
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Masur« th« studmts* ability to think conv«rgently to arrive at a best or 
correct answer ^ however open-ended foraats are also used. The student 
responds in sosm written (verbal or symbolic) fora. Foraats include selection 
iteM (aultiple-cboioer true/falssr satching) , suK^y iteas (fill in, short 
answer) and essay iteas (limited and extended response). Paper and pencil 
assignaents aay be used for in-progress aonitoring or for aore foraal 
assessaents conducted after instruction is coapleted. Hany educators tend to 
link selection iteas with the aeasureaent of recall and essay iteas with the 
aeasureaent of higher order thinking skills.- However r as we proceed through 
th€ guider we will strive to show that aultiple-choice and true/C^alse iteas 
also can serve to aeasure soae higher-order thinking skills. For exaaple: 
Was infantry invasion of Japan a viable alternative to the use of th^ 
atoaic boab to end Nini? If so, why? If not, why not? 

a. Yesr transport ships were available in sufficimt nunbers. 

b. Yesr island defenses in Japan were ainiaal*. 

c. Nor estiaated casualties would have been auch greater. 

d. Nor Japan was on the verge of having an atoaic boab. 

Perforaance tests . In this fora of assessaentr the teacher observes and 
judges an activity in progress or a product developed by the student. 
Students are presented with a set of instructions (perforaance exercise) : 
they respond in sobm overtly behavioral aannerr and teachers observe and 
evaluate the qi.ality of the behavior and/or resultirj product in 
teras of pre-specified perforaance standards or criteria (Stiggins^ 1984). 
These Bight be foraal assessaents for grading purposes or less formal 
assessaents integrated into instruction. Such assessaents play key roles in 
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the aeasureMnt of reasoning strategiesr coonunication skills ^ sotor 
development r foreign language proficiency r science laboratory procedures r 
etc. Perfornance assessaents call upon the student to demonstrate what they 
know by doing it andr in som instancesr to explain their strategies. 

The three forss of assessment were included in the guide because sany 
teachers already design and use them. Therefore r they can cOTtrol the extent 
to which their assessments measure more than siflv^le recall. Tests that 
accompany textbooks and items that appear on standardized achievement tests 
also measure student achievementr but t^tachers typically have less control 
over these. To the extent that teachers can play a role in the selectio;i of 
texts or published tests and want those materials to measure specific higher 
thinking skills, they can use information presented in this guide to screen 
and select materials that reflect higher«-order objectives of instruction in 
their classrooms. 

The Basic Chart 

By combining the five types of thinking and the three forms of classroom 
assessment described above # we create a framework or chart to guide classroom 
measurement of key concepts. 



ASSESSMENT PLANNING CHART 

Oral Paper a Performance 

Questioning Pencil Tests Acsessaent 



Recall 








Analysis 








Compar ison 








Inference 








Evaluation 









2161. 



ERIC 



Using this chart , wa can aelact one elaaent of instruction at a particular 
grade laval^aay, an elaatntary science unit on the SOIAR SYSTEM— and show how 
the nature of the assesaaent varies across levels and fon of assessment. 

Beginning with sisple recall : During instruction, we sight pose this 
question to the class: 

Today, we are beginning a unit on the solar systea. what is the 

solar systen? 
Or, we might pose an analysis question: 

Let's see if we can identify U^e parts of our solar system. 
Oral questioning in class might also deal with comparisons : 

ffe have been sending unmai^ned space flights to Mars. How is 

Mars like the earth? How is it different? What about size, 

distance from the sun, surface, atmosphere, etc.? 
The cGmpleted chart on page 13 illustrates the remaining categories under oral 
questioning. 

Moving to more formal paper and pencil testing, the questions might look 
like this: 

Recall : Define solar system. 

Analysis : Match each planet with its unique characteristics: 
E arth a. has rings of gas and ice crystals 
M ars b. appears red in night sky 
V enus c. farthest from the sun 

Saturn d. is known to support life 

P luto e. ulled the evening star 

f . revolves around the sun 

g. is part of the Milky Way 

The remaining paper and pencil testing for other skill categories appear in 
the chart on the next page. 
2161e 
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f UBJICT •ci^r^o^ 



OIUO, ^ TI8T PUtfOKMMICB 



MCALL 


Today M b«9in a unit on thm wolmx 
•ytm, m^t do you think tho color 
oyoUA io7 


Oafina aolar ayatas. 


Ghoosa tha nana of a planat. X (tha 
taachar) an who Sun. Put youraalf in 
orbit around m oonaidariag whara you 
aro In rolation to othar planota and 
hoM far you aro twam tho tun. Uaa 
d inchoa to rapraaant aach Million 


iyiM.y8X0 


Iiot'o ooo if wo can tshink of all of tho 
porta of our aolar ayatoM. 


Match aach planat with ita uniquo 
charaotariatioa t 

larth a. haa ringa of 9aa and ica 

Vanua b, appaara rad 
_^ Saturn o* aupporta lifa 

Itc. Itc, 


■ixoa Ob oiatanoa* 

Parformanoa critariat 

Haoall-'-'Do atudanta rasaabar ordar 
and diatanca? 


OONPAMSM 


Ma'va l>oon aanding unnannad opaca 
fli9lita to Nora, How ia Mara lika 
Earth? How ia it diffarant? 


Tha dun and tha planata ara all 
OQoponanta in our aolar ayataa* How 
doaa tha tun diffar froa tha planata? 


Oo^pariaon— Can thay raflact ralationa 
aaong planata? 

Znfaranca— Can thoy uaa tha diatanca 
aoala? 


mrguNCs 


Tho planota lotata around tho dun and 
rovolva in a dofinita pattam* Nhatdo you 
think aight happan if ona of tho 
planata auddanly ohangad orhit? 


iBagina that wo diaoovarad a now planat. 
Nhioh of tha following ara wa likaly to 
know firat? 
(a) ita aiaa 

<b) how Mny noona it haa 
(o> aurfaoa tarrain 




SVALUATION 


Hhich part of tha aolar ayttaa ia aoat 

laportant to ua hara on Sarth? Nhy7 


If you tfora aalactad to traval to Mara* 

would you 907 Nhy or why not? 





IS 
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Finally, p«r£orwince assMaatnt (obaarvation and judgment) can serve an 

instructional functiont ^ 

Choose the nsM o£ a planet. I (the teacher) aa the Sun. 
Put yourself in orbit around ae considering where you are 
in relation to other planets and how far you and the other 
planets are froa the Sun. Use one inch to represent each 

■illion Biles of distance. ^ 

For each individual child, this aeasures recall (order and distance), 
analysis and coi^arison (in relation to other planets) and inference (use of a 
■easureaent scale). For those students who place theaselves incorrectly, the ^ 
teacher can ask follcw-up oral questions to deteraine which coaponent skills 
are not aas tared. 

In the next section, we provide a range of exaaples of these kinds of ^ 
tables covering concepts studied in a nuaber of subjects at various grade 
levels. These examples are followed by a specific and very practical set of 
guidelines for developing and using such charts for your own classroon ^ 
assessaent. 

i 

i 
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LEARNING TO PLAN THB ASSESSMENT 

"Questions are the creative acts of intelligence* 

Frank Kingdoa 

In this part of the guide, we have collected examples of completed and 
partially coapleted ASSESSMENT PLANNING CHARTS. Each chart focuses on one 
topic or concept and presents exaaples of how that concept can be assessed for 
all five skill categories using all three foras of assessnent. For the sake 
of illustration r we have selected topics froa three general subject natter 
areas taken froa three different grade levels. Within ea<^ cell in the 
aatrixr we have seJected a topic that is soaewhat familiar to all: 

Elementary English: Poetry 

Junior High Social Studies: Electoral College 

Junior High Science: Energy 

High School Social Studies: Branches of Government 

Study step 1: Reviewing Model Charts 

As a study strategyr we reoommend that the reader proceed through these 
charts one by one examining the exercises presented in each. Occasionally, we 
have inserted a blank cell in the chart. The reader is invited to fill in the 
blank. Try to complete each chart as best you can. If some cells are just 
too difficult to fill, leave then blank . You can return and complete them 
later. 
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MfUSNWT fUOIIilllO CHJUIT 
iUMlCT ^li^ 



tone ^^'f 



OML TEST yiMOHMAIICl 





L9f9 B— it w can tttll MiMt po«try 


An Haiku kas linss and 
syllablss. 


Oo^para sova work of local poata. Chooaa 
tba ona you lika bast. As you know, 
srtists srs oftsn «ot 'raoofnlsad* until 
aftsr tbair doatks so thsy oftan liva in 
povarty. You mx^^ on a board wbich 
oottld balp this post you kava okoaan. 
Now would you fo about oonvinoing tha 
board to giva funds to this psrtioulsr 
post? trspars your Mtariala for 
oonvinoing. Try tbsa out on tha olaaa. 


ANALVflS 


L«t'0 Ma how Mny diffttrwit kinds of 
pMtsy CM list. 


Tsll tks ipurposs of an sorostio in 
postry snd writs s brisf sxaapls 




ooapan ••vnrttl kinds of pootxy 
M to rkysinf toohniqus» rhytlwi» 
stniotiiro, ste. thnll wo first 
oo^psrs s linsriok snd s ooivlst? 


r*it an M if a Haiku# a C if a oouplat* 
and a D if a diaivnta. 

Ca) kaa 1? ayllaklaa 

<b) kaa a linaa 




mriuiCB 


■svo sovsrsl posM for uss on tks . 
ovsrtMsd or iirittsn on tlio bosid for 
ksndouts. ttudonts chooss s posa and 
Ansfins kow it aight sound writtsn ss 
snsthsr fox«. Nsiku ss a oouplst, sto. 
9iit sawpl— OA tks boaid. 


Hkat kind of poaa is liksly to ba writtsn 
by s Japanons parson? 

U) liasrick 

lb) ooupist 

<o) Haiku 

Id) cinquaia 




■VALUATION 


00 ymt'tkink it's iaportant to snoours9s 
tks writing of postvy? Mhy or «hy not? 


Bam postry ia vary atvucturad. Oo you 
prafar i\ to tka lass stniotursd? Miy or 
why not and oita two axaaiplas of tka kind 
of poatry you prafar. 
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GRAOI LEVEL ^""iog High 



A88E8SNENT PLANNING CHANT 
SUBJECT Social studio 



TOPIC gltctoral Coll»q< 



ONAL 



TEST 



PENPONMAMCE 







Aa a waabar of tha alactoral oollaga, 
you Buat votat 

(a) acoordin9 to your own jud9Mnt 

(b) aa your oonatituancy votad 

(c) aa tha party tall* you 

<d) only if vou wiah to dc^ an 


AaauM you'ra a US tanator. Propoaa 
a oonatitutional ananteant that would 
■aka tha popular vota tha aola 
oritarion in alaoting a praaidant* Your 
MMdMnt would do away with tha alactoral 
collaga* Prapara a ipaach to Congr«ia 
dafanding your aaandMnt. ta aura toi 

(a) analyta all alaaanta of tha 
iaaua 

(b) oo^para alactiona with and 
without tha oollaga 

(c) ahow how tha votara ara likaly to 


AMALYilf 


Now dOM thm •lootoral ooll«9a work? 


Afialysa Uia atdpa in th# praaidant&al 
alaction procoaa ahowing whara tha 
alactoral oollaga ooaaa into play. 


CONPAMiOM 


How do Cho •ocial conditions that aviotod 
«hon thm oloctoral oollo^o wao fonMd 
diffor fro« conditions now? 


Nhat ia Maant by tha alaetion thM 
«ona paraon, ona vota* and how doaa 
that ralata to tha alactoral oo: ^aga? 


raarn 

|d) atata and dafand your valuaa 

(Or conduct a aiaulatad dabata on tha 
Sanata floor.) 


INPENENCE 


If you iMrt a prooidontial candiddto 
•l«otod by popular vota, could 
you atill looaa tha alaction? How? 


In which atata ia tha alaotorata likaly 
to oppoaa tha uaa of tha alactoral 
collagai 

U) California 

(b) illinoia 

<c) North Dakota 




EVALUATION 


SKould tha alactoral oollaga ba 
aboliahad? Why or why not? 


Which of tha following ia a raaaon for 
auiintaining tha alactoral collaga? 
(«) 

(b) 
(o) 
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BEST COPY AVAILABLE 


2^) 



CTI^pg LBVBL Junior iCi9>> 



MtMSNMt PLMMIMO CHMT 
•WJBCT •<:i^^ 



00 



COMPARXfOM 



INlTBUMCB 



BVALUATZOM 



o moi 

May iw*r« lM«ifiaiii9 • unit on onorgy. 
Lot*o dovolop ft doflnition for tho word 
•ooKfy. 



Lot*tt ooapAro tho coots of u«in« tho 
follovinv onorgy oouroooi nuoloor, 
iolor, ooal • w«tor, ifood on4 vind. 



If wo woro ottddonly cut off fros tho 
oiWly of potroloua froi tho Nlddlo 
Boot, «bot would bo 9am ohort ton 
pcoblo«o7 Mhot would bo oom long 
ton iolutiono to thooo probloM? 



Hbot oro tho throo of focto of Bining 
ond burning ooal? 



writo o ohort popor tolling which io 
tho MDot ioportont onorgy oourco for 
tho Ut. 

Oivo ot looot ) roooono why it*o aoot 

i^ttUit. 



PBBfOlMhilCB 



You ovo plonaiag to build o no 
Ooaporo tho onorgy oouroM* Dooido %diioh 
you*U uoo in your houoo. Bi^ioin how 
you*U uod tho oourooo yott*vo chooon. 
Uoo toll wby you dhooo that oourco for 
thot poiticttlor job. Vuu My droM tho 
pUno ohqwing tho voriouo plocoo of 
onoigy uor if you winh. if you do thio 
with o good oxplOMtion hoy thon you nood 
not writo on ovplonotion. 



0. 
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ERIC 



ORAOl LtVWL Hi9h School 



A88B86MIIIT PLANMIIIQ CHJUir 
SUBJECT SocUl studlM 



TOPIC BranchMofthtt Ck>v«raai«nt 



OIUO. 



TEST 





NboU in olHirgs of thm Mttcutlv* 
branai of govarnMnt? Tha JuaicUl 
branch? Logltlaturtt? 




MALTEIS 




Nhot can tho oxooutivo branch do 
about an unfair law? 


OOMMiaSON 


In ABtrlctt wtt httVtt CongrMt. In c«n«da 
thttlr l09Ulttturtt is callod PttrllaMnt, 
How do thoy 41f for in stnicturo? 
OR 

CoMporo tho otructuro of fodorol govomaon 

with tho otructuro of vour ttttft Cdvomaion 


t 

t. 


XNPEMNCB 




You'va docidod notorcyolaa oauaa too Many 
aecidonta. You'd lika thw bannod frcs 
fadarally fundad highwaya. To which 
govamoant branch would you f irat appaal? 

(a) axactttiva 

(b) judicial 

(c) lagitlativa 


BVAtmTXON 


Which branch of tho qovornaiont io 
wot iaportont? Why? 





PEErOEMMICE 

Sat tba olaaa up aa a daaocracy 
with throo branchoa of govanuMnt, Go 
through tha actual procaaa of patting 
a law« Pataxmina if atudontt know and 
can carry out aach function. Striva 
to daaonatrata 'ha intaractiona aaong 
branch aa* 
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study 8f p 2t Using the G€nTic Chart 

Mow that this twi* ; and fillin task is completed r it aay have beooae ^ 
appacant that questions tapping the saae level of cognitive operation have a 
great deal in cn— nn act cm chv tSr even though the topic changes. This fact 
has allowed us to develop a "generic chart*~a kind of for aula cliart in which ^ 
we have provided generic questions in which the teacher sii^ly fills in the 
concept or topic to be assessed* 

AFTER TOO BkVB ATTBMPTED TO CQNFUBTE ALL OP TBB PREVIOOS CHAKTS, study the ^ 
generic chart and use its foraula questions to fill in any blanks you were 
unable to oonplete the first tlM through the charts presented in Step 1. 

i 



i 



i 



i 
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GRADB LEVEL 



ASSESSMENT PLANNING CHART 

Subject G^Mtu chrt 



TOPIC 



ANALYSIS 



CONPAEISOH 



INPEWBNCB 



EVALUATION 



Nhttt itt 7 


Itittt itt ths bttst dofinition for tha 
ton ? 

U) 
Cb) 

(0) 


How do«tt work? 


What ^xm tho bMio ttlMonttt Cifigrvdionttt) 

of ? 


OOMDMTtt thtt to 


Mhat itt tho Mjor diffsronoo botwMii 
•nd ? 

(•) 

(e) 


Mbat do you think would lMpp«n 
if ? 


Which of thtt following im • liksly rMult 
of ? 

M 

M 

(c) 


Itt thitt • Mtittfttctory solution to this 
pxdblm 7 How would you 
do it? (Follow upt i4)y?) 


Umtm im thm ittttutti 

Which ttidtt •f you on and why? 


BEST COPY AVAILABLE 



PEEFOEMANCE 

Oiva a apaoch/plan • dabata in t#hich you 

uaa what you know about 

to judga ita 



Giva 
viaiw 



raaaona to axplain your point of 
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study Step 3: oalng th« Potaula to Ggneraf a Coig>l«te Chart 

The next step in the learning proceite is to use the generic chart to | 
coaplete an entire chart on a topic of interest and at a level appropriate to 
you. Here we aust add a caution. We do not reooanend on-going reliance on 
the generic chart. It is aerely included here as a learning aid. Once the 
reader understands the levels and the process of coaposing an ASSESSMENT 
PLMOiZNG CHART, it will beooM clear that aany different kinds of probes can 
trigger student thinking. We illustrate this fact below. But for now, use | 
the generic chart to generate a coaplete ASSBSSMBNT PLMmZNG CHART on a topic 
of relevance to you. If you need to sake ainor revisions to the wording of 
the generic itea fora to write a good exercise, feel free to do so. It is | 
intended for flexible use. 

« 

3 J 
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study Sf p 4: Adding Variety to th% Questions 

How lets K>ve frca the "forwla" chart to the generation of charts with a 
greater variety of questions. The first key to expanding the range of 
questions you can pose is to focus on the trigger or action verb used to 
describe the problea to the student. Start with these and add soae of your 
own if you can: 



If you want to 
■easuret 

Recall 



Use these key words 
in the exercise: 



define 

identify 

label 

list 

nane 

repeat 



what 
when 
who 



Illustration 

List the naaes of 
the aain characters 
in the story. 



Analysis 



subdivide 
breakdown 
separate 
categor ize 
sort 



Break the story down 
into different 
parts. 



C caparison 



coaipare 
contrast 
differentiate 
distinguish 



Conpare themes of 
these two stories. 



Inference 



deduce 

predict 

infer 

speculate 

anticipate 

iirtiat if... 



apply How might we make 

conclude this character 

more believable? 



Evaluation 



evaluate 

judge 

assess 

appraise 
defend 



argue 
recommend 
debate 
why 

critique 



Evaluate this 
story. Is it well 
written? Why or 
why not? 




2161e 



23 



34 



The second key to ej^anding the range of questions /ou can pose is co plug 
these action words into a growing list o£ generic questioris. Again, consider 
these and add som of your oim if you can: 
Recall 

• Define the word . 

• Hhat is a ? 



• Label the following , 

• Identify the in this 

• Who did 7 

Analysis 

• Whet are the basic elMents (ingredients) in a 



• What im/axm the functions of 

• Inventory the parts of . 

• Categorise thm of 

• Sort the . 

• Analyse the following . 

Comparison 

• Coaipare the before and after. 

• Contrast the to the - 



• Differentiate between and 

Inference 

• Hypothesize what will happen if 

• Predict what would be true if 



Conclude what the result will be if 



What if had happened instead? 

What does this inforaation suggest? 
Given this situation (problen) what should you do? 
What rule applies in this case? 
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Bvaluation 

• What do you believe about 



• Judge what would be the best way to solve the problem 
of . Why did you decide that? 

• Evaluate whether you would 

or in this situation, why? 

• Decide if was worth it. Explain. 

Ose these lists of action verbs and questions to generate a complete chart 
another topic of relevance to you. 
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GMM LIVIL 



kSBMSBHSm PUUOIINO CHART 
8I»JBCT 



TOPIC 



OKAL WgT FlUrOMWiCg 



UCALL 



ANALYSIS 



COMPARISON 



INPBRBNCt 



8VALUATI0N 



3/ 



Pinal Step: A Progress Check 

In the space provided next to each exercise, enter the letter that 
represents the thinking skill category reflected in the item (See Appendix B 
for answers) : 

R « Recall 
A ■ Analysis 
C « Conparison 
I ■ Inference 
£ « Evaluation 

1. What are 3 functions of the liver? 

2. Let's brainstora what would happen if the sun did not cone 

up tosocrow. 



3. Define the word nitasis. 

4. Which of the following menus is the best? Why? 

5. Which menu provides more complete protein? 

6. Should the use of computers be abolished in the classroom? 
Why or why not? 

7. Who is the author of Where the Sidewalk Ends? 

8. If we mix these chemicals together, what do you suppose 
will happen? 

9. Look at the chart showing the number of meals Americans 
have eaten away from home in the last three years. How 
have eating habits changed? 

10. What are three purposes of an unmanned space flight to 
Jupiter? 

11. What are the functions of our eyelashes? 

12. Which do you think will have greater impact on your life, 
the invention of the computer or our ability to travel in 
space? Why? 

13. If you were going outside and it was snowing quite hard, 
which of the following i#ould you need from your closet? 

a) Your umbrella 
b) A light weight jacket 

c) Your warm boots 
d) Your sandals 
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14* You hate rain, buc know it is necessary* What are three 
purposes it serves? 

15. In the Northwest it rains and snows a lot. Which is worn 
vital for the necessary supply of water for susser use? 

16. What are sosm jobs a migrant worker might perform in 
getting a crop of lettuce to market? 

17* Haiku is a form of • 



18 • Look at the three paintings. Which makes the most use of 
vivid colors? 

19 • Suppose we had not dropped the bombs on Hiroshima and 
Nagasaki, how else might we have defeated the Japanese? 

20* Which is a better snack for your a fresh peach or a dish of 
frozen peach yogurt? Why? 



■ii) 
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MARIMG ASSESSMENT NORK IN THE OASSROON 



•The easily observable fact is that children are passionately eager 
to sake as such sense as they can of the world around thea, are 
extreaely good at it r and do it as scientists do, by creating 
knowledge out of experience. Children observe, wonder, find, or make 
and then test the answers to the questions they ask theaaelves. when 
they are not actually prevented froi doing these things, they 
continue to do then and to get better and better at it." 

John Holt 

Now that the basic structure and elements of the ASSESSMENT PLANNING CHART 
are in place, hew do we make it work for us in the classroom? Here are seme 
simple guidelines for: 

Developing questions for daily use in the classroom 

1. To repeat an earlier point: Learn and use a set of categories such 
as the one presented here. Ours* works well for us, but may not meet 
your needs. Many teachers are familiar with the Uxonony of 
educational objectives in the cognitive domain developed by Bloom and 
others (1956). For those who prefer that framework, the categories 
of the cognitive domain are defined and illustrated with key action 
verbs in Appendix C. But the key point is to choose one, learn it 
and refer to it for consistency . 

2. Use textbooks as a guide for the selection of priority topics to be 
assessed throughout the range of thinking skill categories. This 
will assure a match between content taught and what is tested. 

3. Actually develop written charts Jor key units and crucial concepts 
before t eaching them. This will s^ve planning and test develc^ent 
time, and it will give you a written record to use every time you 
teach that unit over the years. 
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4. Set up a file or notebook of conpleted charts. This will save time 
later iihen you want to retrieve them. 

5. Carefully evaluate the assessments that often acco^)any textbooks. 
Even though they oome from the publisher they may not match the 
cognitive categories covered in the text or covered in your 
instruction in class. If they don't match, use your own assessments 
or adapt and improve those that don't fit. 

6. Develop questions which encourage divergent thought. This gives room 
for answers which might not be quite so common or usual. Divergent 
thought develops the following which are the basis for creative 
thinking: 

- Flexibility of ideas 

- Fluency of ideas 

- Spontaneity 

- Uniqueness 

7. Teach your students the different categories of thinking skills. 
Then they'll know your expectations. Post the categories and key 
trigger words prominently in the classroom for easy reference by you 
and students during discussion. 

8. Involve students in the process of brainstorming questions at 
different levels for their own tests. One person's thought may 
trigger something in another's mind. A new question is developed. 
This concept is called itchhiking." This will help students 
internalize the levels and it will save you test development time. 
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Have teachers using the same text or unit get together to brainstorm 
to develop questions. 

Ask students what they would like to know about a new, upcoming 
subject. Then, they will have something at stake in the development 
of the unit and will better understand its purpose. 
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Here are ao— itftegies for aanaging the asseaaaent process : 
1. Mien you aak a queaticiir wait for a response. Teachers r on the average , 
wait less than a second after asking questions. Yet according to Rowe^ 
(1978) a three to five second wait tiae seeaed to iaprove both student 
responses and teacher reactions, what happens to students v.hen teachers 
#ait longer for the to answer? Rowe suggests that: 

The length of student response increases. Explanatory statements 
increase in length. 

The nusriDer of unsolicitedr but appropriate responses increases. 
Failure to respond decreases. 
Confidence of children increases. 

The incidence of speculativer creative thinking increases. 
Teacher ^centered teaching decreases r and student*centered interaction 
increases. 

Students give aore evidence before and after inference stateaenta. 
The nuaber of questions asked by students increases. 
The nuaiMr of activities proposed by the children increases. 
Slow students contribute acre* 

The variety of types of responses increase. There is nore reacting 
to each other r structuring of procedures , and soliciting. The 
incidence of speculative thinking increases. 

• Discipline probleas decrease. 
Instructors change also: 

• They exhibit aore flexible types of responses. 

• The nuaber and kind of teacher questions change. 

• Teacher expectations for student perforaance is aodified. They 
becoae less likely to expect only the brighter students to reply and 

view their class as having fewer acadeaically slower students. 

32 
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2. Set up questions on 3X5 cards. These cone in five colors and white. Each 
level of questions can be a different color. 

• You can use these when it is tine to prepare your written assessaent. 

• If working with the inquiry wthod, these cards nay be put in a file 
box for classrooa use. Students can choose which card they would 
like to work on individually or with a group. 

3. Avoid questions which can be answered with a "yes" or "no." Or, if you 
use then, call for an explanation of the response from the student. 

4. When a child has incMC>l«tely or incorrectly answered a question, give 
soae 2;ust. lining feedback; folloir-up with a question such as: 

• Can you explain that further? 

• Why did you think that? 

• Did you consider 7 

• Did you reaeaber to 7 

m On what inforaation do you base that? 

• What evidence suggests that? 

• Is there another way of looking at this? 

This helps the diild arrive at a defensi?>le answer and develops the 
higher-order skills. 

5. Whenever possible auring oral questioning, use all the component 
categories frov. lower to higher order to advantage. Begin with recall and 
proceed st^o !>y ste)) to evaluation, making all the stops along the way. 

In this way, :,'Ou can bring students along. Or if you start at a complex 
level and a student has difficulty, go back to recall and work back up to 
the level where the error occurred. This will reveal the nature of the 
error made. 
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6. Ask one student to paraphrase or explain what another has said. 

• Johnr could you say vhat Mary just said in different words? 

e In other words r what was Sam saying r Pete? 
7« Keep the whole class involved. 

e Call on nonvolunteers regular ly-*8o those not raising hands imist 
reaain tuned in. 

e Have thai listening to add to what soMone else has said. Have 
students frequently ocMuent on or add to other am^wers. 

e Have students raise their hand, click their fingers, etc. if they 
agree. 

e Have students preparing to write a report, conent on or evaluate the 
discussion. 

8. Frequently have students considering questions in groups. 

e This offers eaotional support and a feeling of inclusion, 
e Usually students will be less anxious. 

e This allows for a pooling of infornation and generally results in the 

developsMnt of nore ideas, 
e Individual talents aay be shared and/or developed. 

9. Use questions for written, as well as oral work. Several groups could be 
working with the saae question. While five groups are discussing and 
working on the question for a written or oral report, the teacher could be 
talking with and questioning another groi^. 

10. If students are %rorking in groups, be sure they are aware of all sources 
for inforaation. pevelop with them a list of where they can go for 
inforaation. 
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11. Be sure students working in groups know hov to organize: 

• Their tiae. 

• Their paper, folders, files, «tc. 

• Their aethods of working together. 

12. Use your questions for other purposes. 

e Design a bulletin boaru «.ull of questions. 

• Set up a learning center with lots of choice of things to do which 
require higher-order skills. 

13. Use your ability to develop questions to evaluate texts for a new textbook 
adoption, and to evaluate standardized tests considered for use in the 
district. 

14. Be sure the students have learned (or know where to find) the knowledge 
(facts) upon which to develop higher level thinking. 

15. Be sure you, the teacher, have adequate knowledge of the subject area so 
that you aay be able to evaluate the thinking cC your students. 

16. Reaenber to use the various categories for all work. Do not use higher 
order skills during class and then switch to recall for tests or use 
higher order for performance but stay at the recall level on daily 
assessBent. 

17. Encourage students to beooae the discussion leaders or noderators. 

18. Encourage students to track their own developnent. They can 

e conpare their progress to that of others or perhaps to themselves 
last year, 

e rate themselves on rating scales reflecting levels, 

e keep diaries or logs of evidence of effective functioning in all 

categories, and/or 
e keep a file or folder of work produced and evaluations 
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19 • Have another teacher observe your claaa during a typical discussion and 
record results. 

This siaple chart sight serve to collect tally marks to reflect questions 



atteapted—with 


correct 


responses 


circled: 






Student 


Recall 


Analysis 


Ccnparison 


Inference 


Evaluation 


Jennifer 








o 




Scott 








III 




Shaya 






TO 






Travis 


Z 










Michael 








XX 





By using such chartSr it becoaes easier at student or parent- teacher 
conference tine to give som concrete infornation as to the thinking 
skills of a student. 
20. Set criteria for grades to reflect importance of moving beyond recall. 
Extra points mi^t be given for higher order skillsi recall could get one 
point r whereas evaluation could get five. 
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SUMMARY 



We believe that the new wave of educational improvement is focusing on the 
iaprovraent of reasoning skills. These are che new "basic skills." Many 
state departments of education and the prominent national associations of 
educators are launching major developmental efforts in this direction. One 
key to the success of these efforts will be each individual teacher's ability 
to measure thinking skills in a valid and reliable manner. This guide is 
designed to help teachers acquire the needed assessment sicills. 

We have defined workable categories of thinking skills, illustrated how 
those categories relate to three prominent modes of classroom assessment, and 
provided guidelines and practice in adapting assessments to actual classroom 
practice. But this is only a start. 

Two more critical components must be added if quality classroom assessment 
is to result. (1) You must continue to practice with the ASSESSMENT PLANNING 
CHART. This will allow you to internalise the categories so they become 
second nature. You will be thinking in terms of thinking skills. (2) You 
must continue to learn the key to sound test item writing and performance 
assessment. Without these basic skills — and they don't take long to 
aoquire~the foregoing cannot serve you well. Available resources are listed 
in Appendix B. 

We suggest that you find a partner or form a small group to grow together 
in these skills. You can learn much from each other. 
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APPENDIX A 

Additional Resources for Classroon Aasessaent 

Fleaing, M. & Chanbera, B. (1983) Teacher-made testa: Windows to the 
classrooa. In ^.E. Hathaway (ed.) Testing in the schools > New 
Directions in Testing and Measurement. No. 19 San Francisco, CA: 
Jossey-'Bass. 

After three years of analyzing teachers* tests in the Cleveland schools, 
the authors of this study provide a unique and insightful glimpse of what 
teachers test, how they test and (presumably) what they value in the 
curriculum. Initiated originally as a result of a court mandated order to 
ensure that all district testa, including teacher made tests, were 
administered, scored and used in a non-discriminatory manner, the district's 
test analysis probed test design, formatting, legibility, understandability, 
bias and most importantly the nature and quality of the test items. Results 
showed that the 342 tests from all grade and subject areas met requ^roaents 
for non-discriminatory uses of questions, but displayed other surprising 
characteristics particularly in respect to the type and level of questions 
used most frequently. 

In analyzing the kind of questions used, Fleming and Chambers report that 
teachers overwhelmingly preferred short answer questions and showed minimal 
interest in essay items. Less than 2 percent of the some 9000 items reviewed 
were essay basdd. Teachers also relied heavily on test questions that sampled 
knowledge of facts. Knowledge of facts along with knowledge of terms and 
rules constituted almost 80 percoit of the test questions reviewed. On the 
other hand, only a minimal number of test items required students to apply 
learning. 
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The resultfl of this review and Fleming and Chaayber's reoognition that what 
we test is what students learn because tests inevitably shape the curriculua 
proapted developsient of high quality series of aodules for inservice training 
on classrooa testing. Titled "Four Keys to better Classrooa Testing" (see 
following reference), these teacher training aaterials recoanend sound 
strategies for iaproving the design and quality in classrooa tests. 
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Four keys to classroom testing , A aultinedia training package published by 
Educational Testing Service and distributed by CTB-McGraw Hill, Monterey, 

As a result of their evaluation of teacher made tests, Fleming and 
Chambers (see previoi^s abstract), working in collaboration with ETS, developed 
this inservice training package, designed to help teachers i^>rove the quality 
of their day to day paper and pencil tests. The training materials provide 
teachers with detailed guidelines in overall test planning, test item 
construction (focusing on selection, supply and essay item types) ^ test 
assembly and test ateinistration. 

The package has three features that make it particularly worthwhile. 
First, the information presented is very practiced and is of high technical 
quality. Second, the material is presented in a nontechnical manner. 
Assessment procedures are clearly explained and well illustrated. And third, 
major concepts are illustrated in several ways. For the trainer irtio is not a 
testing specialist, the package includes a cooiplete slide/tape presentation. 
For the user more conversant with testing concepts, ^transparencies are 
included to accompany the workshop presentations and exercises outlined in a 
trainer's manual. 

This training package is well worth the cost, if the goal is to assist 
teachers in becoming better teachers. 
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Gronlundr N.B* (1982) Constructing acfaieVtfBent testa > Inglewood Cliffs^ NJ: 
Prentice Hallf Inc« 

This relatively inexpensive paperback is aaong the aost concise a. d 
practical introductory textbook on educational Masurenent available* In a 
brief 140 pages, the author distills the aost isportant aeasureMnt guidelines 
for assisting teachers in the assesssent of student achieveoent via 
teacher-developed tests^ standardised tests are not considered. 

The book specifies and describes five steps for effective achievement 
testing: (1) specify the dosuiin of skills to be seeauredr (2) develop a 
representative saaple of assessaent exercises r (3) assemble exercises into an 
efficient forsr (4) administer and caref' Uy interpret assessMnt results, and 
(5) use results to improve instruction. 

h thorough discussion about key issues in designing or planning a quality 
test ueachers interested in measuring bigber order thinking skills will find 
this discussion helpful); siipler carefully illustrated guidelines for writing 
oood test items; useful recommendations for designing and using essay testsi 
and a descriptive chapter on using performance-based measures in the classroom 
are clearly discussed by the author. Quality control guidelines for 
maximizing test reliabUity and validity in formal and informal classroom 
tests are also specifically addressed. 

In sbortr this instructional guides written especially for teachersr is an 
excellent introduction to fundamental issues in educational measurement. 
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Spand€l, V, (1981) Classroon applications of writing assesaaentx A 
teachar's handbook > Portland, OR: Northwest Regional Educational 
Laboratory* 

I 

This handbook provides classroon teachers with (1) the basic principles 
for evaluating student writing samples using holistic, analytical and primary 

I trait sooringi (2) extensive experience in the application of these scoring 

strategies to hypothetical samples of student writing? and, (3) a series of 
very practical and immediately useful ideas for using these scoring strategies 

I in day-to-day writing instruction* 

Writing assessment, notes the author, can be used in the classroom in many 
varied ways. 8om teachers, for example, have found that teaching students to 

I evaluate on another's writing makes them better critics of their own work and, 

ultimately, better writers* Others have found that systematic evaluation of 
student writing — using the kinds of scoring approaches discussed in the 

I handbook— can be very useful in diagnosing individual riadents' strengths and 

weaknesaes. And still others use writing tests to select students for 
placewient into advanced or remedial writing courses* 

I This handbook illustrates the many ways writing assessment can be used 

advantageously in teaching basic writing skills* It also provides specific 
guidelines for relating writing assessment co day-to-day instruction and for 

^ involving students in the writing sample scoring process in order to teach' 

writing skills* 

The handbook, moreover, represents a unique treatment of assessment 
i issues— one tailored specifically for the classroom teacher iri)o has no formal 

background in testing* 
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Stiggins, R.J. (19845 Evaluating students by classroqi observation: Watching 
students grow . Washington, DC: National Education Association (ISBN 0- 

This publication offers teachers specific, practical guidelines for using 
perforaance assessMnt to Masure student behavior and/or products and 
specifies procedures to ensure test quality. The author contends that 
systeaatic test design and careful quality control aake performance 
assessMnts an objective, useful, and valuable form of classroom assessment. 

To develop quality performance assessments, the author recommends a 
four-*8tep sequence of specific planning decisions and testing alternatives. 

Step one involves describing the assessment situation, determining the 
specific reason for testing, identifying ^o reads and wants test results, and 
describing the skills and/or knowledge to be demonstrated. 

Steps two and ttiree call for a specification of the test activity and 
task (8) students will be asked to perform, and a description of the student's 
response to be evaluated. In doing so the teacher decides (1) whether a 
process (behavior, procedure) or product (result of doing) is to be rated, 
(2) what criteria will be used to judge performance, and (3) whether or not 
students are to be informed of the performance evaluation. 

Step four requires that teachers plan rating procedures by selecting 
scoring methods and evaluators (teacher, another es^rt, students, self or 
peers) , and by determining whether student results will be compared to one 
another or to a preset standard. 

After outlining these essential planning steps, the author specifies key 
considerations in ensuring quality assessment. These include clear testing 
purposes, effective communication about assessment, maximizing objectivity and 
selecting appropriate and economical options whether one uses preplanned tests 
of performance or spontaneous observations of classroom behavior. This 
succinct booklet provides thorough guidance in usiA<< observation to measure 
Q Student performance. 



APPENDIX B 
Apsnttts To Quiz on Pages 27-28 

1. Analysis. The key nord is functions. 

2. Inference. The key is the what. ..if. 

3. Recall. The k^ nord is define. 

4. Evaluation. The keys are which is best and why. 

5. Ccnparison. 

6. Evaluation. The key is that there is a choice to be made and then a 
justification given. 

7. Recall. 

8. Inference. The key words are if and what. 

9. Inference. Generalizations must be drawn on the basis of conparison. 
10« Analysis. The key word is purposes. 

11. Analysis. The key word is functions. 

12. Evaluation. The key is that a choice must be made and justified. 

13. Inference. The key words are if... which... would. 

14. Analysis. The key word is purposes. 

15. Evaluation. The key is that a choice and a justification must be given. 

16. Analysis. The key words are what are some and might perform. 

17. Recall. 

18. Comparison. The key is that one particular thing is being cos^ared in 
three paintings. 

19. Inference. The key words are suppose and how else. 

20. Evaluation. The key are the words which is better and the necessity for 
justification. 
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APPENDIX C 

Cognitive Dona in Levels According To Bloom 



If you want to meaaure; 
Infocnation recall 



Start the exercise with 
these key words; 



list 

describe 

define 

label 

repeat 

name 



fUl in 

identify 

what 

when 

who 

when 



Examples 

List the parts of 
speedi. 



Comprehension 



Application 



Analysis 



Synthesis 



Evaluation 



paraphrase 
explain 
review 
match 
discuss 

apply 
construct 
draw 
simulate 
sketch 

classify 
dissect 
distinguish 
differentiate breakdown 



translate 
interpret 
how 
i«hy 



eaploy 
restructure 
predict 
how 



contrast 
categor ize 
separate 



compare 

combine 
relate 

put together 



judge 
argue 
assess 
appraise 

decide 
defend 



subdivide 

integrate 
assemble 

collect 



rate 

debate 

evaluate 

choose 

should 



Explain irfiat purpose 
the verb serves in a 
sentence? 



write ^ sentence that 
includes a noun, a 
verb and direct 
object. 



Break down this 
sentence into its 
component parts by 
diagramming it. 



Combine what you know 
about good sentences 
and good paragraphs to 
write an essay on ... 

Evaluate this 
paragraph. Is it 
good? Hhy or why 
not? 
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